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ABSTRACT 

Recent  advances  in  weapon  systems  and  combat  simulators 
have  increased  the  need  for  higher  resolution  data  for 
terrain  appreciation  and  threat  prediction  applications. 
To  date,  the  Defense  Mapping  Agency's  (DMA)  Digital 
Terrain  Elevation  Data  (DTED)  Level  1  database,  an 
elevation  matrix  with  3  arc  second  or  100-meter  post 
spacing,  has  been  used  by  most  military  and  Department  of 
Defense  (DOD)  users  when  elevation  data  was  required  for 
modeling,  simulations  or  other  applications.  The  advent 
of  the  Tactical  Terrain  Data  (TTD)*  prototype  and  its 
corresponding  DTED  Level  2  cell  (1  arc  second  spacing  or 
30-meter  post  spacing)  has  afforded  joint  service  users  a 
unique  opportunity  to  compare  the  two  databases  in  terms 
of  their  uses  for  relevant  applications,  especially  line- 
of-sight  (LOS).  A  major  aspect  of  the  Army's  evaluation 
of  the  TTD  prototype  involved  a  comprehensive  comparison 
of  DTED  Level  1  vs.  Level  2  conducted  by  the  Digital 
Concepts  and  Analysis  Center  (DCAC)  at  the  United  States 
Army  Topographic  Engineering  Center  (TEC),  Fort  Belvoir, 
VA  and  the  prototype  study  area.  Fort  Hood,  TX.  The 
accuracy  of  masked  and  unmasked  areas  within  LOS 
prediction  plots  (using  DTED  Level  1  and  Level  2  as 
input)  was  compared  to  actual  LOS  plots  compiled  in  the 
field  for  selected  origin  points. 

This  paper  will  present  an  overview  of  the  unique 
procedures  employed  to  compile  LOS  in  the  field.  It  will 
also  provide  a  review  of  the  comprehensive  analysis 
performed  on  the  DTED  generated  LOS  and  the  field  LOS. 

The  findings  of  the  field  investigations  will  be  used  to 
ascertain  whether  currently  available  DTED  represents  the 
real  terrain  adequately  for  joint  services  applications. 


Current  TTD  is  a  prototype  digital  terrain  data  set 
containing  vector  based  features  and  attributes  and  a 
high  resolution  elevation  matrix.  Subsequent  TTD  will 
be  produced  by  DMA  (circa  1997)  to  satisfy  future  joint 
services  requirements. 
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INTRODUCTION 


Prediction  of  line-of-sight  (LOS)  conditions  has 
always  been  an  essential  aspect  of  the  battlefield. 
Knowledge  of  the  surrounding  terrain  and  its 
corresponding  elevation  has  even  more  implications  today 
in  the  modern  Army.  Recent  advances  in  weapon  systems 
and  combat  simulators  have  increased  the  need  for  higher 
resolution  data  for  terrain  appreciation  and  threat 
prediction  applications.  To  date,  DMA's  DTED  Level  1 
database,  an  elevation  matrix  with  3  arc  second  or  100- 
meter  post  spacing,  has  been  used  by  most  military  and 
DOD  users  when  elevation  data  was  required  for  modeling, 
simulations  or  other  applications.  The  advent  of  the  TTD 
prototype  and  its  corresponding  DTED  Level  2  cell  (1  arc 
second  spacing  or  30-meter  post  spacing)  has 
afforded  joint  service  users  a  unique  opportunity  to 
compare  the  two  databases  in  terms  of  their  uses  for 
relevant  applications,  especially  LOS.  In  fact,  a  major 
aspect  of  the  Army's  evaluation  of  the  TTD  prototype 
involved  a  comprehensive  comparison  of  DTED  Level  1  vs. 
Level  2  conducted  by  DCAC.  The  following  discussion 
outlines  this  effort  which  was  accomplished  through  a 
series  of  field  trips  to  the  prototype  study  area  at  Fort 
Hood,  TX. 


PURPOSE 


The  purpose  of  this  study  was  to  compare  the 
accuracy  of  masked  and  unmasked  areas  within  LOS 
prediction  plots  generated  from  DTED  Level  1  and  Level  2 
to  plots  compiled  in  the  field.  These  evaluation  results 
were,  in  part,  used  to  ascertain  whether  the  elevation 
information  contained  in  TTD  represented  the  real  terrain 
adequately  for  joint  services  applications. 

METHODOLOGY 
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DCAC  initiated  its  field  work  with  a  site  visit  to 
the  TTD  prototype  area  during  March  1989.  A  number  of 
prospective  LOS  origin  points  were  identified  at  this 
time;  corresponding  geographic  coordinates  were 
determined  using  a  DMA  1:50,000  scale  topographic  line 
map  (TLM) .  Four  points  (A-D)  were  eventually  chosen  for 
analysis  and  stakes  placed  in  the  ground  to  mark  their 
locations.  DCAC ' s  engineering  support  contractor 
produced  1:24,000  scale  DTED  Level  1  and  Level  2 
prediction  plots  (on  transparent  media)  for  each  point 
using  the  origin  coordinates  as  ascertained  in  the  field. 
These  coordinates  were  subsequently  verified  as 
sufficiently  accurate  (mean  error  45  meters)  for  the 
purposes  of  this  study  through  differential  positioning 
methodology  with  a  GPS  receiver.  Finally,  DCAC  personnel 
revisited  the  origin  points  to  compile  field  LOS  plots 


which  would  later  be  compared  to  the  DTED  Levels  1  and  2 
prediction  plots. 


PROCEDURE 


The  field  LOS  plots  were  acquired  via  a  four  step 
process : 

1)  For  initial  orientation,  the  DTED  prediction 
plots  were  registered  to  a  1:24,000  USGS  TLM  on  which 
each  specific  origin  point  had  been  carefully  mapped.  A 
visual  inspection  of  the  site  was  then  conducted  whereby 
all  obvious  errors  in  the  prediction  plots  were 
annotated.  This  procedure  helped  to  clarify  the  plots 
for  later  analysis. 

2)  The  field  team  split  into  two  crews. 

3)  The  first  crew  set  up  a  theodolite  at  the  origin 
point  to  obtain  lines  of  azimuth.  The  azimuths  were  shot 
at  approximately  20  degree  intervals,  with  intermediate 
rays  focusing  on  special  terrain  conditions,  in  a  360- 
degree  sweep  around  the  site. 

4)  The  second  crew  traveled  along  each  azimuth 
remaining  true  to  the  heading  via  directional 
instructions  radioed  to  them  by  the  first  crew.  Whenever 
sight  was  lost  or  gained  along  each  azimuth  in  relation 
to  the  origin  point,  a  distance  measurement  was  taken 
using  laser  distance  measuring  equipment.  LOS  lost 
because  of  intervening  vegetation  was  noted  and 
differentiated  from  LOS  lost  because  of  terrain  in  order 
to  obtain  the  most  precise  representation  of  reality.  In 
addition,  conditions  existed  at  Fort  Hood  where 
vegetation  did  not  actually  obstruct  LOS,  but  prevented 
clear  view  of  the  underlying  ground  surface,  such  as  on  a 
tree-covered  ridge.  In  this  case,  the  character  of  both 
LOS  conditions  was  recorded;  one  representing  clear  LOS 
from  the  origin  point  to  the  lower  edge  of  the  tree  line, 
and  one  representing  LOS  from  the  tree  line  to  the  top  of 
the  ridge  indicating  that  the  ground  surface  was  not 
visible  but  that  LOS  extended  to  the  ridge  line.  This 
recording  procedure  continued  on  each  azimuth  until  sight 
was  permanently  lost. 

In  addition  to  the  LOS  measurements,  photographs 
were  taken  and  landmarks  noted  in  a  360-degree  panorama 
around  all  four  points.  This  information,  in  conjunction 
with  the  annotated  prediction  plots  (see  step  1  above), 
proved  valuable  in  terms  of  orientation  during  subsequent 
plotting  of  the  data. 


PLOTTING  THE  DATA 


The  raw  data  collected  in  the  field  were  plotted 
onto  1:4800  scale  aerial  photographs  obtained  at  Fort 
Hood  and  covering  the  study  area.  These  photographs  were 
vital  in  assuring  correct  initial  alignment  and  accuracy 
of  the  azimuths.  Once  this  was  accomplished,  the  field 
fans  (those  areas  determined  to  be  visible  from  each  of 
the  four  field  origin  points,  including  any  masked 
regions  contained  within  them)  were  reduced  to  1:24,000 
scale,  then  overlayed  and  compared  to  the  DTED-generated 
LOS  prediction  plots.  LOS  or  the  lack  of  it  within  the 
field  fan  is  depicted  in  three  ways  on  the  field¬ 
generated  plots.  A  solid  line  indicates  clear  sight,  a 
dashed  line  indicates  the  presence  of  vegetation  on 
otherwise  visible  ground,  and  the  absence  of  a  line 
indicates  sight  blocked  by  terrain  or  lost  at  the  distant 
horizon . 


ANALYSIS 

LOS  analyses  for  this  study  were  conducted  based  on 
2  areal  configurations:  1)  the  total  prediction  area  and 
2)  the  field  fan.  The  total  prediction  area  roughly 
equals  the  lO-by-10  minute  prototype  study  area  while  the 
field  fan  is  a  variably  sized  area  dependent  upon  LOS 
conditions  around  a  given  observation  point. 

Tables  1-8  summarize  results  of  the  comparison  of 
DTED  predictions  versus  field  results  for  each  of  the 
four  LOS  origin  points.  The  tables  present  results  of 
prediction  confidence  for  the  total  prediction  area  as 
well  as  within  the  field  fan  only.  These  aspects  of  the 
DTED  prediction  must  be  considered  in  tandem  to  achieve  a 
complete  understanding  of  the  field  analyses.  Unmasked 
and  masked  areas  were  identified  and  analyzed  since 
errors  in  either  one  may  have  serious  implications  on 
joint  services  applications. 

Coincidence  Within  the  Field  Fan 


The  first  comparison  analysis  undertaken  between  the 
DTED  prediction  plots  and  the  field  data  was  the 
determination  of  coincidence  within  the  field  fan  (see 
Tables  2,  4,  6,  &  8).  In  this  analysis,  the  rest  of  the 
prediction  area  was  ignored  and  only  coinciding  masked  or 
unmasked  areas  within  the  field  fan  were  measured  to  es¬ 
tablish  a  percentage  of  coincidence.  Next,  in  order  to 
determine  a  measure  of  integrity  for  the  combined  masked 
and  unmasked  areas,  the  percent  coincidence  values  were 
assigned  a  weighting,  based  on  percentage  of  areal 
coverage  within  the  fan,  and  finally  averaged.  The 
resultant  weighted  average  coincidence  percentage  is  one 
way  to  assess  the  accuracy  of  the  DTED  prediction  plots 


Table  1 

Summary  of  Line  of  Sight  Prediction  vs.  Field  Results 
(Total  Prediction  Area) 

Line  of  Sight  Point  A 


Line  of  Sight 
Condition 

Prediction 

(m^ 

Field  Results 
(m^ 

Prediction  Error 
—Under  +-Over(nr^ 

DTED  1 

Unmasked 

31.3  X  10® 

.9  X  10® 

+30.4  X  10® 

Masked 

205.8  X  10® 

236.2  X  10® 

-30.4  X  10® 

Total 

Prediction  Area 

237.1  X  10® 

237.1  X  10® 

N/A 

DTED  2 

Unmasked 

4.2  xlO® 

.9  X  10‘* 

+3.3  X  10® 

Masked 

232.9  xlO® 

236.2  X  10® 

-3.3  X  10® 

Total 

Prediction  Area 

237.1  X  10® 

237.1  X  10® 

N/A 

Table  2 

Summary  of  Line  of  Sight  Prediction  vs.  Field  Results 
(Coincidence  within  the  Field  Fan) 

Line  of  Sight  Point  A 


Line  of  Sight 
Condition 

Prediction 

(m? 

Field  Results 
(m^ 

Coincidence 

(%) 

Weighted  Average 
Coincidence  (%) 

CIEILJ. 

Unmasked 

0.84  X  10® 

0.88  X  10® 

95 

95 

Masked 

0.00  X  10® 

0.00  X  10® 

100 

cm2_2 

Unmasked 

0.63  X  10® 

0.88  X  10® 

72 

72 

Masked  0.00  x  10®  0.00  x  10®  100 


Table  3 

Summary  of  Line  of  Sight  Prediction  vs.  Field  Results 
(Total  Prediction  Area) 

Line  of  Sight  Point  B 

Line  of  Sight 
Condition 

Prediction 

(m^ 

Field  Results 
(m^ 

Prediction  Error 
-Under  +-  Over  (m^ 

DTED  1 

Unmasked 

18.3  xlO® 

.8  XlO® 

+  17.5  XlO® 

Masked 

196.9  xlO® 

214.4  XlO® 

-17.5  XlO® 

Total 

Prediction  Area 

215.2  X  10® 

215.2  X  10® 

N/A 

I2IEIL2 

Unmasked 

3.2  xlO® 

.8  XlO® 

+2.4  XlO® 

Masked 

212.0  XlO® 

214.4  xlO® 

-2.4  XlO® 

Total 

Prediction  Area 

215.2  X  10® 

215.2  X  10® 

N/A 

Table  4 

Summary  of  Line  of  Sight  Predic  don  vs.  Field  Results 
(Coincidence  within  th;  Field  Fan) 

Line  of  Sight  Point  B 

Line  of  Sight 

Prediction 

Field  Results 

Coincidence 

Weighted  Average 

Condition 

(m^ 

(m^ 

(%) 

Coincidence  (%) 

aiED.  1 

Unmasked 

0.76  X  10® 

0.84  X  10® 

90 

85 

Masked 

0.20  X  10® 

0.29  X  10® 

69 

eiED  2 

Unmasked 

0.84  X  10® 

0.84  X  10® 

100 

74 

Masked 

0.00  X  10® 

0.29  X  10® 

0 

Table  5 

Summary  of  Line  of  Sight  Prediction  vs.  Field  Results 
(Total  Prediction  Area) 

Line  of  Sight  Point  C 


Line  of  Sight 
Condition 

Prediction 

(m^ 

Field  Results 
(m^ 

Prediction  Error 
—Under  +»  Over  (m^ 

DTEP  1 

Unmasked 

19.0  X 10® 

4.2  XlO® 

+  14.8  XlO® 

Masked 

196.2  X 10® 

211.0  XlO® 

-14.8  XlO® 

Total 

Prediction  Area 

215.2  X  10® 

215.2  X  10® 

N/A 

DTED  2 

Unmasked 

27.3  xlO® 

4.2  XlO® 

+23.1  XlO® 

Masked 

187.9  xlO® 

211.0  XlO® 

-23.1  XlO® 

Total 

Prediction  Area 

215.2  X  10® 

215.2  X  10® 

N/A 

Table  6 

Summary  of  Line  of  Sight  Prediction  vs.  Field  Results 
(Coincidence  within  the  Field  Fan) 

Line  of  Sight  Point  C 


Line  of  Sight 
Condition 

Prediction 

(m^ 

Field  Results 
(m^ 

Coincidence 

(%) 

Weighted  Average 
Coincidence  (%) 

I2IEI2J. 

Unmasked 

1.12  X  10® 

4.23  X 10® 

26 

54 

Masked 

3.05  X  10® 

3.47  X  10® 

88 

DTED  2 

Unmasked 

3.47  X  10® 

4.23  X  10® 

82 

68 

Masked 

1.72  X  10® 

3.47  X  10® 

50 

Table  7 

Summary  of  Line  of  Sight  Prediction  vs.  Field  Results 
(Total  Prediction  Area) 

Line  of  Sight  Point  D 


Line  of  Sight 
Condition 

Prediction 

(rcP) 

Field  Results 
(m^ 

Prediction  Error 
—Under  +- Over  (m^ 

DTED  1 

Unmasked 

17.7  xlO® 

2.0  XlO® 

+  15.7  XlO® 

Masked 

197.5  xlO® 

213.2  XlO® 

-15.7  XlO® 

Total 

Prediction  Area 

215.2  x  10® 

215.2  X  10® 

N/A 

DIEI2_2 

Unmasked 

3.1  xlO® 

2.0  X 10® 

+  1.1  XlO® 

Masked 

212.1  XlO® 

213.2x10® 

-1.1  XlO® 

Total 

Prediction  Area 

215.2  X  10® 

215.2  X  10® 

N/A 

Table  8 

Summary  of  Line  of  Sight  Prediction  vs.  Field  Results 
(Coincidence  within  the  Field  Fan) 


Line  of  Sight  Point  D 


Line  of  Sight 
Condition 

Prediction 

(m^ 

Field  Results 

Coincidence 

(%) 

Weighted  Average 
Coincidence  (%) 

DTED  1 

Unmasked 

1.34  X  10® 

2.00  X 10® 

67 

55 

Masked 

0.09  X  10® 

0.60  X  10® 

15 

DTED  2 

Unmasked 

1.70  X  10® 

2.00  X  10® 

85 

72 

0.17x10®  0.60x10® 


Masked 


28 


compared  to  the  real  world  —  but  only  within  the  field 
fan.  Conclusions  cannot  be  fully  drawn  from  this 
analysis  until  the  total  prediction  area  is  scrutinized. 

Total  Prediction  Area  Evaluation 


In  this  analysis,  the  prediction  area  (approximately 
lO-by-10  minute  area)  around  each  origin  point,  including 
the  field  fan,  was  evaluated  (see  Tables  1,  3,  5,  &  7). 
All  unmasked  and  masked  areas  not  matching  the  field 
results  were  considered  in  error.  These  areas  of  error 
were  tabulated  (in  square  meters)  to  determine  the  total 
under  or  over  prediction  error  within  the  DTED  LOS 
prediction  plots  for  each  point.  It  is  obvious  that  the 
value  of  a  database  for  LOS  support  increases  as  over  and 
under  prediction  errors  are  reduced.  Therefore,  this 
analysis  is  important  in  that  it  provides  a  measure  of 
DTED  integrity  over  a  large  viewing  area. 

Graphic  Comparison 

In  order  to  graphically  portray  the  DTED  visibility 
prediction  versus  ground  truth  for  each  observation 
point.  Figures  1  through  4  were  prepared.  These  figures 
show  the  spatial  distribution  of  both  correct  and 
incorrect  predictions  about  each  point. 

RESULTS  SUMMARY 


The  main  concern  that  the  DCAC  field  team  attempted 
to  address  during  the  LOS  investigations  was  that  of 
determining  which  dataset,  DTED  Level  1  or  DTED  Level  2, 
best  represents  the  real  world  in  terms  of  supporting 
future  Army  applications.  The  following  section  will 
attempt  to  clarify  the  performance  of  DTED  Level  1  and 
Level  2  by  integrating  the  results  of  the  field  fan  and 
total  prediction  area  analyses  for  each  point. 

Prediction  Coincidence  Within  the  Field  Fan  vs.  the  Total 
Prediction  Area 


In  the  field  fan  analyses,  DTED  Level  1  was  the 
better  predictor  for  points  A  (95  percent  vs.  72  percent) 
and  B  (85  percent  vs.  74  percent)  as  shown  in  Tables  2 
and  4.  However,  much  of  the  coincidence  in  the  Level  1 
data  for  points  A  and  B  is  mitigated  by  the  extremely 
high  prediction  errors  that  occur  in  the  total  prediction 
area  around  these  points.  The  DTED  Level  1  prediction 
plots  overestimated  unmasked  areas  by  over  30  million 
square  meters  for  point  A  and  over  17  million  square 
meters  for  point  B,  two  of  the  worst  predictions  in  the 
entire  study.  As  noted,  the  DTED  Level  2  prediction 
plots  for  points  A  and  B  were  slightly  worse  predictors 
in  terms  of  coincidence  within  the  field  fan;  however. 


Figure  I  Predicted  Visibility  DTED  1  and  2  vs  Ground  Truth 


Predicted  Visibility  DTEO  1  and  DTED  2  vs  Ground  Truth 


Figure  3  Predicted  Visibility  DIED  1  and  2  vs  Ground  Truth 
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Figure  4-  Predicted  Visibility  DTED  1  and  2  vs  Ground  Truth 


their  performance  over  the  corresponding  total  prediction 
areas  was  excellent.  Prediction  errors  measured  only  3.3 
million  and  2.4  million  square  meters  for  points  A  and  B, 
two  of  the  three  best  predictions  in  the  study  ( see 
Tables  1  and  3). 

In  the  field  fan  analyses  for  points  C  and  D,  DTED 
Level  2  was  the  better  predictor  (68  percent  vs.  54 
percent  and  72  percent  vs.  55  percent)  as  shown  in  Tables 
6  and  8.  The  DTED  comparisons  for  the  total  prediction 
area  around  point  D  are  easily  discernable.  The  DTED 
Level  2  prediction  error  measured  only  1.1  million  square 
meters.  This  was  the  lowest  error  measured  in  the  study 
and  was  in  stark  contrast  to  the  15.7  million  square 
meter  prediction  error  on  the  DTED  Level  1  plot  (see 
Table  7).  Results  for  point  C,  however,  were  not  as 
clear.  Although,  as  stated  above,  the  DTED  Level  2  plot 
had  a  slightly  better  coincidence  within  the  field  fan, 
it  predicted  poorly  in  the  total  prediction  area  with  a 
prediction  error  of  23.1  million  square  meters  versus 
14.8  million  square  meters  for  Level  1  (see  Table  5). 

CONCLUSIONS 


Several  conclusions  are  evident  in  light  of  the 
results  above: 

-  Both  coincidence  within  the  field  fan  and  accuracy 
of  prediction  for  the  total  prediction  area  must  be 
evaluated  when  attempting  to  determine  a  preference 
between  DTED  Level  1  and  DTED  Level  2  for  the  generation 
of  LOS  prediction  plots  (see  Figures  1-4).  The  accuracy 
of  a  prediction  plot  for  the  total  prediction  area  around 
an  origin  point  is  equally  as  important  as  its 
coincidence  within  the  corresponding  field  fan.  High  LOS 
coincidence  near  an  origin  point  can  be  mitigated  by 
gross  prediction  errors  in  surrounding  areas.  This  is 
precisely  the  situation  found  at  points  A  and  B.  The 
gross  misprediction  of  the  DTED  Level  1  prediction  plots 
in  the  total  prediction  area  around  points  A  and  B  more 
than  negates  the  high  coincidences  (84  percent  and  95 
percent)  evident  within  the  field  fan.  In  contrast,  the 
correspondence  of  DTED  Level  2  prediction  plots  in  the 
total  prediction  areas  around  points  A  and  B  was 
excellent  (see  Tables  1  and  3)  with  field  fan 
coincidences  still  over  70  percent.  The  superiority  of 
DTED  Level  2  was  also  evident  at  point  D  where  the  total 
prediction  area  was  almost  perfectly  predicted  (see  Table 
7)  and  a  72  percent  weighted  average  coincidence  value 
was  recorded  within  the  field  fan.  For  these  reasons, 
DTED  Level  2  data  must  be  considered  the  better  overall 
predictor  for  LOS  at  points  A,  B,  and  D,  especially  D. 


-  Neither  DTED  Level  1  nor  DTED  Level  2  performed 
well  at  point  C.  Within  the  field  fan,  the  DTED  Level  2 
prediction  plot  had  a  higher  coincidence  (68  percent) 
than  the  Level  1  plot  (54  percent)  but  both  had 
unacceptable  prediction  errors  in  the  total  prediction 
area.  The  DTED  Level  2  plot  overpredicted  LOS  by  23 
million  square  meters  while  the  Level  1  plot 
overpredicted  LOS  by  14  million  square  meters.  Both 
plots  exhibited  some  areas  of  reasonable  correspondence, 
but  neither  prediction  was  considered  consistent  enough 
to  be  useful.  Complex  terrain  conditions  around  point  C 
seem  to  have  taxed  the  limits  of  DTED  accuracy  and/or 
resolution,  thus  limiting  the  prediction  capabilities  of 
both  data  sets.  In  any  event,  the  difficulty  in 
predicting  LOS  around  point  C  clearly  exemplifies  the 
need  for  caution  when  using  digital  elevation  data  for 
LOS  predictions.  Indeed,  all  digital  topographic  data 
(DTD)  must  be  intelligently  evaluated  in  terms  of 
accuracy  and  resolution  limitations  before  being  used  for 
simulation  or  battlefield  applications. 

-  Although  results  at  point  C  were  inconclusive,  LOS 
around  the  three  remaining  points  was  clearly  better 
represented  by  the  prediction  plots  generated  from  DTED 
Level  2 .  DTED  Level  2  is  a  more  consistent  predictor  of 
LOS  than  DTED  Level  1  and  its  use  and  importance  will 
increase  as  joint  services  applications  become  more 
sophisticated . 


